Hexagonal Warping Effects on the Surface Transport in Topological Insulators 
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We investigate the charge conductivity and current-induced spin polarization on the surface state 
of a three-dimensional topological insulator by including the hexagonal warping effect of Fermi sur- 
face both in classical and quantum diffusion regimes. We present general expressions of conductivity 
and spin polarization, which are reduced to simple forms for usual scattering potential. Due to the 
hexagonal warping, the conductivity and spin polarization show an additional quadratic carrier 
density dependence both for Boltzmann contribution and quantum correction. In the presence of 
warping term, the surface states still reveal weak anti-localization. Moreover, the dielectric function 
in the random phase approximation is also explored, and we find that it may be momentum-angle- 
dependent. 

PACS numbers: 73.25.+i, 72.10.-d, 73.20.At 



I. INTRODUCTION 

Topological insulator (TI) has been attracting a great 
deal of research both experimentally and theoretically in 
the past few years*— due to its potential applications in 
topological quantum computation^ and spintronics— A 
TI has a full energy gap in bulk, while there are gap- 
less surface states stable against weak disorder and weak 
interaction unless time-reversal symmetry is broken— *L 
In particular, the number of its Dirac points is odd ac- 
cording to a no-go theorem;* in vivid contrast to the 
graphene— Hence, many theoretical studies focus on a 
class of TI where the surface states only consist of one 
Dirac cone. 

Experimentally, the surface state has been well con- 
firmed by angle-resolved photoemission spectroscopy 
(ARPES). 9-11 However, the transport observation of sur- 
face state in classical diffusion regime meets an obstacle 
due to the large bulk-conduction background. Recently, 
Checkelsky et al. claimed to have isolated the surface 
band contribution in Bi2Se3 by electrostatic gate control 
of chemical potential— £ Nevertheless, this work is ques- 
tionable for the reason that the chemical potential is still 
in the bulk conduction band,— Theoretically, D. Culcer 
et al. investigated the two-dimensional surface charge 
transport and obtained results analogous to the ones of 
graphene— - Recently, Kim et al. showed that the surface 
of thin Bi2Se3 were electrostatically coupled, strongly. 14 
They observed the surface transport by using a gate elec- 
trode to remove bulk charge carriers, completely, and 
well demonstrated the theoretical prediction.— It is very 
likely that this experiment has overcome the above ob- 
stacle. Also, the surface anomalous Hall conductivity in 
TI was calculated using quantum Liouville equation. 15 
The electron-phonon scattering limited conductivity was 
investigated for the surface state of a strong TI— - More- 
over, the transverse magnetic heat transport was ex- 
plored on the topological surface—* 

On the other hand, recently, the quantum correc- 
tions to charge conductivity in topological surface states 
were also extensively studied i 12 : 18 " — The surface states 



in quantum diffusion regime (1$ 3> I) reveal positive 
weak localization correction, i.e. weak anti-localization, 
which is related to the tt Berry phase— - Here, I and 
1$ are the elastic scattering length and the phase co- 
herence length, respectively. In contrast to graphene, 
where the weak anti-localization is suppressed by the in- 
ter valley scattering;** the surface states of TI forbid this 
scattering process due to single Dirac cone and many ob- 
servations have confirmed this enhancement to electronic 
conductivity 12 ' 18- — Lu et al. found that the surface state 
of a TI shows a competing effect of weak localization and 
weak anti-localization in quantum transport due to mag- 
netic doping— i 

We have noted that, in most of these theoretical 
studies, only fc-linear term in the spin-orbit interac- 
tion is present in the effective Hamiltonian. However, 
in some TIs, for example Bi2Te3, it was found that 
the shape of Fermi surface changes from a circle to a 
hexagon, and then to a snowflake-like shape with in- 
creasing the Fermi energy by ARPES 11 and scanning 
tunneling microscopy^ 4 - measurement. With the help of 
a hexagonal warping term, this kind of band structure 
was explained by Fu— - Note that the states near the 
Fermi surface are responsible for the transport proper- 
ties at low temperature. Hence, it is expected that the 
warping effect will naturally play significant roles on sur- 
face transport when the Fermi energy is high enough. So 
far, only one theoretical work involves the warping effect 
on the weak anti-localization in the literature—* Further, 
they simply replaced the warping term by its angle av- 
erage one, hence, the anisotropy of energy spectrum due 
to warping is neglected, completely. Then they acquired 
the same form of correction as the usual two-dimensional 
electron gas with spin-orbital interaction. Consequently, 
it is highly desirable to carefully study the warping effect 
on the classical contribution and quantum correction to 
the surface transport. 

In this paper, we study the hexagonal warping ef- 
fect on the charge conductivity and current-induced spin 
polarization (CISP) in the surface state of a three- 
dimensional TI. Considering nonmagnetic and magnetic 
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elastic carrier-impurity scattering, we discuss this prob- 
lem both in classical and quantum diffusive regimes. We 
also investigate the warping effect on the dielectric func- 
tion in the random phase approximation (RPA). The 
structure of the paper is as follows. In Sec. II, the effec- 
tive Hamiltonian of the surface state is given. By using 
a kinetic equation approach, the conductivity and CISP 
in the classical transport regime in the presence of non- 
magnetic and magnetic scattering are calculated in Sec. 
Ill and IV. In Sec. V, we discuss the quantum correction 
to conductivity and CISP. A brief summary is given in 
Sec. VI. 



II. SYSTEM AND HAMILTONIAN 



III. CLASSICAL TRANSPORT IN THE 
PRESENCE OF NONMAGNETIC SCATTERING 

A. kinetic equations 

In order to study the transport property of the surface 
state in the classical diffusive regime, we limit our system 
to a spacial homogeneous one. First, we consider the 
nonmagnetic carrier-impurity elastic scattering and focus 
on the charge transport at the Fermi level inside the bulk 
gap of TI. The kinetic equation for the single particle 
distribution function in the eigenbasis of Ho, p(k), are 
constructed using the nonequilibrium Green's function 
and is given by2£ 



By assuming particle-hole symmetry, the effective 
Hamiltonian of the surface state of a TI including the 
hexagonal warping effect has the following form: 



H Q = v F (k x & y - k y a x 



in 



Here v F and A are the Fermi velocity and the hexagonal 
warping constant, <7j (i = x, y, z) are the Pauli matri- 
ces, and k± = k x ± ik y . A quadratic term fc 2 /(2m) is 
in principle also present in the Hamiltonian with m de- 
noting the effective mass of particle, but it is smaller 
than the fc -linea r and cubic terms due to the relation 
2mv F ^> s/vp/X in Bi2Te3. Consequently, in the regime 
of density, 10 13 cm" 2 < N < 10 14 cm" 2 , both the lin- 
ear and cubic terms contribute significantly to the trans- 
port quantities, and the quadratic term can be safely 
neglected. Near the regime k — 0, the cubic correction 
is also negligible. However, at high density, the cubic 
term makes the energy spectrum of surface state angle- 
dependent and the Fermi surface becomes snowfiake-like. 

The eigenenergies of the considered system (TTJ) can be 
found £fc/j = (— l^efc, where 



= y/{v F k) 2 + (Afc 3 cos3(9 fc ) 2 



(2) 



with the azimuthal angle of k, 9 k = tan 1 (k y /k x ), and 
the index p = 1,2. By introducing the angle 



f3 k = tan 



_ x e k — A/c 3 cos3#fc 
£fc + A/c 3 cos W k ' 

are written as 



the corresponding eigenstates (p kfl 

_ ( sin/3 fc 
^ fel ~ I -i cos foe** 



(3) 



(4) 



eE- V fc p + eE-[p,UlV k U h ]+i[Ho,p] 



d_ 

df 

(6) 

Here E is the electric field. It should be noted that 
here the p(k) is a 2 x 2 matrix. In the lowest order 
of gradient expansion, the scattering integral I sc can 
be written as I sc = $ T Qo dt'\l7G < + £<G a - G"'S < - 
G<S a ] (T, t')(t',T), with E<' r ' a being the lesser, retarded 
and advanced self-energies in the self-consistent Born 
approximation. We consider the scattering by impuri- 
ties at random positions {R a } has the form: V(r) = 
J2{r }V(r—R a ). Therefore, after impurity averaging^ 

the self-energies in eigenbasis of Hq reads S <,r ' a (fe) = 
mE q \V( k ~ Q)\ 2 UtU q G<^ a {q)UlU k , with n t denoting 
the impurity density and V(q) being Fourier transform 
ofV(r). 

Further, we take the generalized Kadanoff-Baym 
ansata 2 ^ and ignore the collisional broadening to sim- 
plify the scattering integral. Throughout this paper, we 
focus on the situation where the Fermi energy e-p is pos- 
itive, i.e., the Fermi energy is in the conduction band of 
surface state, and assume the electric field is along the 
x direction. To the lowest order of the impurity den- 
sity Hi and stationary electric field E = Ex, the solu- 
tion of the equation can be written as p(k) = (k) + 
p (i)(fc) + p (2)(fc). Here p^(k) = dmg[n F (e kl ),n F (e k2 )} 
[n F (x) is the Fermi-Dirac function] is the equilibrium dis- 
tribution function. p^(k) and p( 2 \k) are two distribu- 
tion functions proportional to the electric field. p^(k) is 
the impurity-independent distribution function and only 
the off-diagonal elements p^{k) — p'^ > *(k) — p^\k) + 
ip\ 1 \k) are nonzero, with 



Vk2 



cos/3 fe 
i sin /3fce 1 ' 



(5) 



It should be noted that the above Hamiltonian (TTJ) can 
be diagonalized into H = UlH U k = diag(£fei, e k 2) 
with the help of the local unitary transformation U k = 
(ifki, (f k 2)- This transformation projects the system from 
the spin basis to the eigenbasis of Hq. 



pW(fc) = 



eE 
4ke k 



sin 2f3 k sin 6 k [n F (e k \ ) - n F (e k2 )] , (7) 



Wfj.\ _ eE sin4/J fc (cos40 fc - 5cos20fe) 



Pl'(k) 



16ke k cos 39 k 

X [n F {s k i) - 7l F (£fc2)]. 



(8) 



p( 2 \k) relies on the carrier-impurity scattering, and its 



3 



elements are determined by the following set of equations: 



eE—n F (e k2 ) = 27m, ^ \V(k - q)\ 2 ai (k,q) 
x i 

x \p22( k ) ~ P22W) 5{e k 2-e q2 ), (9) 
2e k pf \k) = nm J2 \V(k - q)\ 2 a 2 (k, q) 

x [f$(k)-f${qj\ S(e k 2~e q2 ), (10) 
-2e k pi 2 \k) = 7m, £ \V(k ~ q)\ 2 a 3 (k, q) 

x [f$(k)-p®(qj\ 5(e k2 -s q2 ). (11) 



(2) (2) 
Pr (k) and p\ (fc) are the real and imaginary parts of 

( 2) 

p\ 2 (k). In these equations 



Oi(fe,q) 
a 2 (k,q) 
a 3 (k,q) 



-[sin2^ fc sin2/3qCos(6' fc - 6 q ) 

+ cos 2/3 k cos 2(3 q + l] , 

- [ cos 2j3 k sin 2(3 q cos(6 k - 6 q ) 



sin 2/3fc cos 2/3 q ] , 
1 
2 



sin 2/3 q sin(0 fe - q ). 



(12) 

(13) 
(14) 



Note that the requirement that ef > 0, but the Fermi 

energy is in the gap of bulk system is assumed, hence, 
(2) 

the diagonal element p\ x '(k) makes no contribution to 
the transport equations. We find that when 8 k — 9 q = tt, 
ai(k,q) = i[cos(2^ fc - 2/3 q ) + 1] = 0. This reveals the 
absence of backscattering, characteristic of TIs. 



B. conductivity and CISP 



In the eigenbasis of Hq, the average velocity v = 
■h J2 k Tr[p(k)ulvU k ]. Here two components of velocity 
operator in the spin basis are written as 



/3Afc 2 cos — iv~p 

Vx = \ i VF -3Afc 2 cos20 fc 



IVY 

/-3Afc 2 sin20 fc 

V —VF 



3Afc 2 sin20 fc 



(15) 
(16) 



It is seen that the diagonal elements of velocity opera- 
tor are also nonzero when we include the warping term. 
Therefore, the longitudinal and transverse conductivities 



&xx = —Nev x /E, a xy — —Nev y /E can be expressed as 
crxx = ~4?y^ [( v f sin 2/3 fc cos 6» fc 

k 

+ 3Xk 2 cos 2(3 k cos 29 k )p22{k) — 2(vp cos 2(3 k cos 9 k 

— 2>\k 2 sin 2j3 k cos 20 k )p r {k) + 2vf sin 9 k pi(k) , 

(17) 

&xy = [( Vf sin 2 /3fe sin fe 

k 

— 3Afc 2 cos 2(3 k sin 29 k )p22(k) — 2(v-p cos 2j3 k sin 9 k 
+ 3Afc 2 sin2/3fc sin29 k )p r (k) — 2vf cos9 k pi(k) . 

(18) 

The hexagonal warping term results in the complex forms 
of charge conductivities. In the surface state of a TI, 
the carrier spin is directly coupled to the momentum, 
in contrast to graphene. Hence, in this system, an ex- 
ternal in-plane electric field can lead to a uniform spin 
polarization^ like spin-orbit-coupled systems^ - — This 
is the so called "CISP". Three components of CISP 
s = Efc ^[p{k)Ui\&U k ] are given by 



- ^2 [ - sin 2/3 k sin 9 k p 22 [k) + 2 cos2/3 fc sin8 k p r (k) 



S<>, — — 



+ 2cos9 k pi(k) 
1 x 



(19) 



2 ^ 

k 



|^ sin 2/3 fc cos 6^/922 (fc) — 2cos2/3 fc cos 9 k p r (k) 

(20) 
(21) 



+ 2sin0 fe p i (fc) 

[ c °s2/3feP22(fc) + 2sin2^ fcj o r (fc) 



It is noticeable that the general expressions (|T7| - ([2T|) arc 
applicable to any scattering potential. 

According to the expressions (O and ((5), it is seen 



that p [ r\k Xl k y ) = (-l) n pi L) [(-l) m k x ,(-l) n k y ] and 

pP(k x ,k y ) = pf ] [{-l) m k x ,{-l) n ky\ with m,n = 
1,2. We find that the impurity- independent distribution 
makes no contribution to charge conductivity and CISP. 
Furthermore, for normal nonmagnetic elastic scattering, 
the potential satisfies the following relation^ 

V{q, 9 q ) = V{q, 9 q - tt) = V(q, 9 q + tt). (22) 

In connection with the kinetic equations (|§))- (ITT1) . 
one can directly arrive at the symmetrical rela- 
tion: p 2 2 2 \k Xl k y ) = (-l) m p^[(-l) m k x ,(-l) n k y ], 
pi 2 \k xi k y ) = (-l) n pi 2) [(-l) m k x ,(-l) n k y ], and 



pf\k x ,k y ) = pY'[{-l) m k x ,{-l) n ky]. Therefore, it is 
clear that a xy = and S x = S z = 0, and the off-diagonal 
elements of distribution function have no effect on the 
charge conductivity and spin polarization. Accordingly, 
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the longitudinal conductivity a xx and the y-component 
of spin polarization can be rewritten as 



form 



e 
E 



^^(up sin 2f3k cos 9k 



+ 3Afc 2 cos 2/3 fe cos 29 k )p 2 2 2 ) (fc), 
S v = \ ^2 sin 2 @ k cos OkPsa 

k 



(23) 
(24) 



For vanishing A, the spin polarization linearly depends 
on the longitudinal conductivity 



S 7/ 



(25) 



This relation is valid for any nonmagnetic elastic scatter- 
ing. The CISP can be observed using the Kerr rotation 
experiment. 32 Since CISP is the characteristic of surface 
state and there is no spin polarization in bulk TIs, this 
relation may provide a simple transport method to iso- 
late the surface conductivity contribution in Bi 2 Se3. One 
first measure the surface spin polarization, and then the 
surface conductivity contribution can be obtained by this 
relation. The remaining contribution of conductivity can 
be considered to originate from bulk band. However, this 
method cannot be applicable for Bi 2 Te3 due to its large 
warping effect. 

The physical reason why only the y-component of CISP 
exists is as follows. The CISP arises because an electric 
field results in an average momentum (k) = —eEr tr with 
Tt r being transport lifetime. This implies from Hamilto- 
nian ([1]) that there is an average spin-orbit field. This 
effective magnetic field leads to this spin polarization. 
When the electric field is applied along the x direction, 
only the y- and z-components of average effective mag- 
netic field are nonzero. Further, the z-component is a 
higher order term of electric field and transport lifetime. 
Hence, in the limit of weak electric field and weak scatter- 
ing, only the y-component of spin polarization is nonzero. 
We emphasize that this argument is very general and 
valid for any scattering, including inelastic phonon scat- 
tering. 



C. 5-form short-range potential 

We first limit ourselves to a Worm short-range non- 
magnetic scattering V(r) = J2{R a } u ^( r ~ Ra)- This 
scattering arises from the surface roughness. For this po- 
tential, the relation (f2"2"j) is satisfied explicitly. Hence, 
only the longitudinal conductivity and y-component of 
CISP exist. To the second order of A, the diagonal el- 

(21 

ement of matrix distribution function, p 22 (k), can be 
obtained analytically. At zero temperature, it takes the 



2eE 



^ cos fc + A 2 -^-(18 008 0* 

£f 4u f v 



riiU 

5 cos 59k — cos 79k 



5{e k 2 - £f) 



(26) 



Substituting the resultant distribution function into Eqs. 
(|23p and (|24[) . the longitudinal conductivity a xx and spin 
polarization S y read 



'XX o 



2 1^1 A 2 

v-p 



32ir 2 \ 2 N 2 



Sy 



eE 



eE 
2-KVpniU 2 



2v F + ^A 2 



(^ 2 + 87r 2 A 2 iV 2 ) 



(27) 



(28) 



The hexagonal warping parameter A leads to quadratic 
corrections of carrier density in the longitudinal conduc- 
tivity a xx and CISP S y . At the same time, the linear 
relation between a xx and S y is broken. We emphasize 
here that the Hamiltonian for A = used in this paper is 
different from the one of Ref. [H] for D = by replacing 



a x and a x 



-a y . Hence, for vanishing A, the 



above results are in agreement with previous onesJ^ It is 
noticeable that the effective Hamiltonian (JlJ is obtained 
for low energy system and the above two equations are 
valid in the density regime, 10 13 cm~ 2 < N < 10 14 cm~ 2 , 
for Bi2Te3. This is the precondition of the whole work. 
Hence, all the equations are limited by this concealed 
condition. 



D. screened Coulomb potential 

We now consider the screened Coulomb potential, 
where the screening function is in the RPA €rpa(q, — 
1 — v c (q)H(q;uj) with v c (q) = e 2 /(2e^nq) being the two- 
dimensional Coulomb interaction. The charged impu- 
rities scattering in the surface of TIs can be modeled 
by this potential well. The corresponding polarizability 
function takes the form: 

nFjekfj,') - n F (£fc+ qM ) 



(29) 



The warping term complicates the calculation of the po- 
larizability function and we cannot get an analytical re- 
sult even for static case and vanishing temperature. The 
screened scattering potential is related to the static di- 
electric function, and is written as V(q) = v c (q) / £rpa(<7)- 
Here the static dielectric function £f(pa(<7) = 1 — 
v c (q)U(q;0). 
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1. static polarizability function 

The static polarizability II(q; 0) for ef to be in the 
conduction band of the surface of TI is given by H(q; 0) = 
n+(q;0) +n-(g;0), where 



n + (g;0)=£ 



ai(fc, k + q) 



«F(£fc2) - n F (e k+q2 ) 



ai(fe, k + q) 



£fc2 ~ £fc+q2 
«F(£fc2) + m{ek+q2) 



n-(g;0)=^ 



ai(fc, k + q) 



£fc2 + £fc+q2 
"F(gfel) + ^F(gfc+ q l) 
£fcl + £fc+qrl 



(30) 



(31) 



Here ai(k, k + q) = l — a 1 (k,k + q). The long- wavelength 
Thomas-Fermi (TF) screening is important for charged 
impurity scattering. In the q — > limit, it is found that 
ai(k, k + q) — > 1. Hence, n~ (q — > 0, 9 q ; 0) — > 0, and the 
polarizability H(q — > 0,# q ;0) is determined by the first 
term of Eq. (|30[) . and at zero temperature we have 



U(q ->O,0,;O) 



£f 
~2tt 2 



COS(flfc - flg 



(32) 



where the angle-related function A(9k,9 q ) — 2v F cos(6*fc — 
^) + 3A 2 4(0 fc )[cos(0 fe -^)+cos(50 fc +^)]. A: F (0 fc ) is the 
Fermi momentum relying on the azimuthal angle, which 
is determined by \Jv F k F (9k) + A 2 fc F (#fc)(cos 39k) 2 = £f- 
For weak A, it has the form: 



M^) = --^(i 



cost 



%)■ 



(33) 



In A — >• limit, the Fermi momentum tends to the pre- 
vious result^ According to N = ^ J Q n d9kk F (9k), the 
relation between the carrier density and Fermi energy is 
given by 



N=± 
4ir 



(34) 



It should be noted that for our case only the magnitude of 
momentum q tends to zero in the long- wavelength limit. 
Therefore, the resultant polarizability H(q — > 0,9 q ;0) 
may still rely on the azimuthal angle of q, which is com- 
pletely different from the 2D Lindhard function— and the 
corresponding polarizability function of graphenei 34 ' 35 
For weak A, the integral (|32|) can be calculated, analyti- 
cally, and the TF dielectric function reduces to 



£tf(<?) = 1 + 



fcxF {9q 



(35) 



with the angle-dependent TF wave vector fcxF^q) 



9 

e £f 



2v F ~3\ 2 E F (l + cos69 q ) . (36) 
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FIG. 1: (Color online) The longitudinal conductivity and 
CISP scattered by screened charged impurities as a function 
of the surface carrier density for both TF screening and RPA 
screening. 



This dielectric function £tf(?) tends to the previous 
resul t 13 ' 35 when A — > 0. We emphasize again that the 
angle dependence of dielectric function originates from 
the cubic term in the Hamiltonian. The A-related term 
becomes important when v F — 



A 2 £p, corresponding to 



Ef = 0.26 eV in Bi2Te3, a density of 10 13 cm 2 , which is 
a realistic density in Bi2Te3 sample ^ 



2. numerical results 

It is seen that the polarizability function (|2l?|) sat- 
isfies U(q,9 q ;tj) = n(g, 9 q - tt;lj) = U(q,9 q + it;uj). 
Consequently, the angle relation of scattering poten- 
tial (|2"2"j) still holds for this screened Coulomb potential. 
Hence, when the carriers are scattered by the screened 
Coulomb form, only the longitudinal conductivity and y- 
component of CISP are nonzero. Now we numerically cal- 
culate the longitudinal conductivity and spin polarization 
for both TF screening and RPA screening. The follow- 
ing parameters in Bi2Te3 are used in the calculation! 13 i 25 
Fermi velocity vf = 2.55 eV- A, warping parameter 
A = 250eV-A 3 , impurity density m — 10 13 cm~ 2 , the 
static dielectric constant k — 200, and dc electric field 
E = lOV/m. The results are plotted in Fig. [0 The 
corresponding conductivity and CISP for A = are also 
plotted for comparison. For vanishing A, the conduc- 
tivity and spin polarization linearly rely on the surface 
carrier density N, which agrees with the previous theo- 
retical calculation. 13 With increasing the density N, the 
hexagonal warping effect becomes important for both TF 
and RPA screened Coulomb potential, leading to nonlin- 
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ear characters of conductivity and CISP. The magnitudes 
of conductivity and spin polarization in the presence of 
warping effect are larger than the ones in the absence of 
warping. Furthermore, we verify that, a xx = c\N +C2N 2 , 
S y = c 3 N + C4N 2 , in contrast to the ones of short-range 
scattering. We note that the TF screening is the long- 
wavelength limit of RPA dielectric function. At the same 
time, for finite magnitude of momentum, the RPA screen- 
ing is weaker than the TF one. Hence, the conductivity 
for TF screened Coulomb potential is larger than the 
RPA one at the same A. 

Here we have assumed that the impurities are located 
right on the surface. However, the charged impurities in 
the bulk of TIs may also contribute to the surface trans- 
port. These remote impurities will enhance the mag- 
nitude of conductivity and spin polarization. One can 
deduce that the warping will lead to a large increase of 
the magnitude of surface transport quantities even in the 
presence of remote impurities. 

Note that the classical surface conductivity of Bi2Se3 
was observed by using a gate electrode^ It showed a 
linear carrier density dependence when the density is 
smaller than the carrier density above which the bulk 
conduction band is populated. In Bi2Se3, the hexago- 
nal warping is small enough to be omitted completely. 
Hence, this experiment verified the previous theoreti- 
cal prediction wellJ^ However, for the surface states of 
TI where the warping term cannot be neglected, such 
as Bi2Te3, the linear dependence will be broken and a 
quadratic relation also appears. Therefore, our predic- 
tion suggests that the surface transport in Bi 2 Te3 should 
be different from the one of Bi2Se3 and it should be very 
careful when one analyzes the surface transport data of 
Bi 2 Te 3 . 



A <C £f, the effect of gap on the energy spectrum, group 
velocity, etc. could be neglected safely. Therefore, we can 
only consider the scattering effect of magnetic impurities. 
Applying the similar procedure as the nonmagnetic scat- 
tering situation, the analogous kinetic equations can be 
derived only by replacing V(k—q), ai(k,q), a 2 (fc,q), and 
a 3 (k,q) in Eqs. ©-(HH) with u M , af(k,q) 7 af(k,q), 
and a^(k,q). Here % = J z S/2 and 



1 



af (k, q) = - - [ sin 2fi k sin 2/3, cos(9 k - q ) 

— cos 2/3^ cos 2/3q — l] , 
a^(k,q) = - i[cos2/3 fe sin2/3qCOs(6'fc - 9 q ) 



+ sin 2f3 k cos 2/3, 
1 



<3J" 



a^(k,q) =-sin2Vin(0 fc -0,). 



(38) 

(39) 
(40) 



Taking into account the symmetrical property of distri- 
bution function, it is also verified that only the longitu- 
dinal conductivity and y-component of CISP are nonzero 
for this magnetic scattering. Eventually, the expressions 
of them are given by Eqs. ([23]) and (j24|) . 

We first assume that the warping parameter is weak. 
Thus the kinetic equation can be solved analytically and 
the diagonal element of the impurity-related distribution 



2eE 



COS 9 k + A 

sf 2v F 



35 



cos 9 k 



17 1 

— cos 59 k - - cos 79 k 



S(e k2 -e F ). (41) 



Hence, the charge conductivity and CISP are written as 



IV. CLASSICAL TRANSPORT IN THE 
PRESENCE OF MAGNETIC SCATTERING 

Let us now address the magnetic scattering case in the 
classical diffusion regime, where the scattering potential 
reads^ 

V(r) = ]T {J\\[s x {r)S x {R a ) + s y (r)S y (R a )} 

+ J z s z (r)S z (R a )}5(r - R a ). (37) 

Here s = ^cr is the spin vector of electron, and S is the 
impurity spin, and Jy, J z are the coupling parameters. 

For simplicity, we assume the classical magnetic impu- 
rities and their spins polarized in the z direction. This 
kind of potential conserves the z-component of the carrier 
spin. It is known that magnetic doping will open a gap 
in the helical Dirac cone^ From the mean field approx- 
imation, the gap has the form^ A = 2riiJ z S. Hence, 
for high mobility sample, the density of magnetic impu- 
rities is small enough, and then the gap opened by the 
magnetic doping is considered to be very small. When 



3u| + 8 



(3w| + 128tt 2 A 2 7V 2 ) , 



eE 



eE 



6v F + 



(3v F + 56tt 2 A 2 N 2 ^ 



lSirvFUiii 2 



(42) 



(43) 



M 



Compared with the short-range nonmagnetic scattering, 
similar density-dependent behaviors have also been seen 
for this magnetic one. However, the concrete coefficients 
are distinct, completely. 

To go beyond the weak warping case, we now nu- 
merically solve the kinetic equations. Setting the relax- 
ation time t = 2v F / {niU 2 A \/ATiNa) — lps with No = 
10 12 cm -2 , the obtained longitudinal conductivity and 
spin polarization are plotted in Fig. [2j For compar- 
ison, the conductivity and CISP without warping ef- 
fect are also calculated. It is seen that for fixed re- 
laxation time the warping term also has important role 
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FIG. 2: (Color online) The longitudinal conductivity and y- 
component of CISP scattered by magnetic impurities as a 
function of the surface carrier density. The other parameters 
are the same as the ones in Sec. MI D 21 
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FIG. 3: The diagrams for the quantum corrections to surface 
conductivity and spin polarization of TI. (a) Bare and [(b)-(c)] 
two dressed Hikami boxes, (d) Equation for the vertex correc- 
tion to velocity and average spin in the ladder approximation, 
(e) Bethe-Salpeter equation for the Cooperon. The arrowed 
solid and dashed lines represent the retarded and advanced 
Green's functions, and scattering potential, respectively. 



on the surface transport of a three-dimensional TI. The 
magnitude of longitudinal conductivity and spin polar- 
ization increase drastically with increasing the surface 
density. Note that the above analytical results Eqs. 
([42]) and (|43l) are valid for weak warping. That is a 
density N -C vf/(5ttX) ps 5 x 10 12 cm~ 2 . For exam- 
ple, if we use the approximation result (|42|) to estimate 
the conductivity, the resultant a xx ps 171.3 e 2 /h when 
N = 30 x 10 12 cm -2 . This value is much larger than the 
numerical one. At the same time, it can be confirmed 
from the numerical calculation that the additional terms 
oc N also contribute to conductivity and spin polariza- 
tion for nonvanishing warping. 



the energy spectrum by its angle average one to investi- 
gate the quantum correction. In our situation the angle 
dependence of warping is taken into account, hence, our 
treatment is beyond this approximation. We also assume 
that the Fermi energy is in the gap of bulk band, and 
crosses the upper band of surface state. Under Born ap- 
proximation, the impurity-averaged equilibrium retarded 
and advanced Green's functions are given by 



Gl /a (e) 



e - e k ± i/2r e ' 



(45) 



V. QUANTUM CORRECTION 

We now focus on the effect of weak warping on the 
quantum corrections to conductivity and spin polariza- 
tion. For this surface state, the Berry phase is calculated 

as 



/•2-7T Q 

/ d9 k (tp k2 \^--\ipk2 

JO Ot>k 

xkUe k ) 



d8 k 



cos 38 k 



(44) 



In connection with Eq. ([33|) . the Berry phase equals tt. 
Hence, the weak anti-localization is expected for the sur- 
face state even in the presence of warping effect. 

Using equilibrium Green's function, the quantum cor- 
rections are described by the diagrams in Fig. [3] 
Firstly, we consider the short-range nonmagnetic scatter- 
ing. Note that in the previous work the authors replaced 



with the relaxation time 



,2 e F 



4a 2 ) 



We 



add a hat on the equilibrium Green's functions to distin- 
guish them from the nonequilibrium Green's functions. 
Notice that we have used a matrix distribution function 
to discuss the classical transport. However, in the ab- 
sence of interband transition process and for usual elastic 
scattering, the matrix distribution reduces to a scalar one 
[see Eqs. ((9|), ([23]) and ([24])], Hence, the kinetic equation 
approach is in principle equivalent to the one-band equi- 
librium Green's functions approach. The kinetic equa- 
tion approach can easily deal with momentum-dependent 
scattering in classical transport, but it is difficult to dis- 
cuss the quantum correction. Therefore, we treat the 
weak anti-localization in the diagrammatic approach by 
using equilibrium Green's functions. Below, the word 
"equilibrium" will be omitted for brevity. 

In the calculation, the vertex corrections to the bare 
velocity and average spin Fig. [3] (d) should be taken into 



8 



account, which are written as 



correction is given by 



A 2 fc 4 
2v F 



v k = 2v F cos 6 k + — - ( 3 cos 9^ + 77 cos 59k — — cos 79k 



A 2 fc 4 / 1 1 

s y k = cos # fc — — — I 3 cos 9k + — cos 59k + - cos 79k 



(46) 

)■ 

(47) 



Different from the topological surface states in the ab- 
sence of hexagonal warping, the velocity and spin vertex 
become anisotropic. This anisotropy is very important 
and will lead to the density dependence of quantum cor- 
rection. Note that in the absence of warping the group 
velocity v k — de k /dk x \\=o = v F cos9 k and average spin 
■ s k = ^ (<Pfc2 |<5" y I ^fe2) I a=o = -jcosflfe. Therefore, for van- 
ishing A, the velocity vertex reduces to22 v k = 2v k . 

In addition to the bare Hikami box Fig. [3] (a), two 
dresses Hikami boxes Fig. [3] (b)-(c) are also needed in 
the calculation of quantum corrections and the total cor- 
rections of charge conductivity is given by 



(48) 



where the quantum correction due to bare Hikami box 



6<T ™ = 2; E ^G r k G q _ k v x q _ k G q _ k G%C(q), (49) 

k,q 

and the quantum corrections due to two dressed Hikami 
boxes 



XX o _ / , 

Z7T * — ; 

k,q,k' 



kk'\ }irapG r q _ k G T q _ h , 



x v q _ k ,G q _ k ,G a k C(q), 



(50) 



8(7^)—— ^ ^fc^Gq_ fc/ (|^fcfc'| 2 )i mp Gg_ fc/ G'g_ fc 



XX O— / ^ 

Z7T ' — ; 

k,q,k' 



x v q _ k ,G%,G%C(q). 



(51) 



Here Ckk' = J dre i{k ' k) ' r {^k 2 \V{r)\ip k ' 2 ) is the scat- 
tering amplitude between two eigenstates. (■■•)im P 
means average over all possible configurations of ran- 
dom impurity. Consequently, for <5-form impurity scat- 
tering, (|6cfc'| 2 )im P = n l u 2 (Lp k 2\tpk'2}(tpki2\pk2)- Since 
the Cooperon C{q) diverges as q — > 0, hence the most 
divergent terms could be obtained by setting q — for 
velocity vertex, retarded and advanced Green's functions 
in the above expressions. Performing momentum k and 
k' integrals, the total conductivity correction is written 
as 



8a x 



£ F < 1 1 I / 



For vanishin g A , this result is in accordance with the 
one in Ref. l2ll Similarly, the total spin polarization 



eEe Y Tl 
2ir vf 



\ 2 ei 



£C(g). (53) 



The Cooperon satisfies the Bethe-Salpeter equation Fig. 
EKe) 

Cfe 1 fe 2 =C kik2 + ^ Cfc, fe/ G k , G q _ k , Ch'k 2 



--C, 



(o) 

k%k 2 



dk'd8 k - 



(2^) 2 



-F(k x ,k' ,q)C k 'k 2 , (54) 
where fe x + k 2 = q, F{ki,k',q) = k'C k %,G r k ,G q _ k ,, and 



by expanding up to A 2 , the bare vertex cj® k for small 
q is written as 



r (0) _ T (0) X 2 T (2) 
°fcifc 2 — fcifc 2 A 1 k 1 k 2 ' 



-(0) 



with 



T 



(0) 

k%k 2 



2e F T e 



(55) 



(56) 



(2) 

The expression of T k k is long and we do not write 
it here. For weak warping, the solution of Eq. (|54|) is 

found as C klk2 = A[% 2 + A^. Ag^ and Ag^ 
are independent of A. With the help of the expansion 
F(k l7 k',q) = F^{k 1 ,k',q) + \ 2 F^{k 1 ,k',q), A^ 

(2) 

and Aj^ fc are determined by the following equations: 
All =TL1 + / ^F^k u k',q)A k \, (57) 



A (2) _ T (2) 
Y1 feifc 2 ~~ - L feife 2 



(27T) 

|^^) (fcl , fe ',,)Ai°). 



(2tt)2 



(2) 
fe'fe 2 



(58) 



Afclfca can be acquired from Eq. (|57l) and then we can ob- 
tain A^ From Eq. ||5SJ). It is found that F^(k u k', q) 
relies on 6^ through cos^, sin^, 008 20^, and 
sin 26'fe 1 . Hence, A^P^ and A k \ have the forms: 



4%, =Ti° 1 ) fc2 + A + At cos 9 kl + Bi sin fcl 
+ .4 2 cos2(9 fcl + B 2 sin20 fel , 



A (2) _ T (2) 
Iy kl k 2 — 1 k 1 k 2 



dk'de k , m (o) 
(2tt) 2 ^ ><D A k>k 2 



-Co + Ci cos fel + 2?i sin 9 kl 
C 2 cos29k 1 +V 2 sm29k 1 . 



(59) 



(60) 



The above coefficients Ai, Bj, Ci, and T>j (i = 0,1,2, 
j = 1,2) are independent of 6 kl and can be determined by 
Eqs. ([57|) and (|58|) . The derivation is tedious but direct. 
By setting fci = k, k 2 = q — k and 8^ — 8 k . 2 = ir for 
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small q and collecting the most divergent terms, finally, 
the Cooperon is obtained as 



C(q) 



1 



5 A 2 4 



epT^q 2 4 v%T^q 2 



(61) 



By performing the integration over q between l/l^ and 
1/7, the logarithmic correction to the conductivity and 
spin polarization are found as 



for. 




(62) 
(63) 



Here we have used the relations / 
with 



Dr e and 1$ — 
constant. It 



■J Dt,!, with D the diffusion constant. it is use- 
ful to rewrite the conductivity correction as 8a xx — 
-q^t In Therefore, the a has the form: 



1 / 3 A 2 4 

2 1 + 4^ 



1 + s — N 

vl 



(64) 



The hexagonal warping makes the prefactor a quadrat- 
ically depend on the carrier density and is always 
smaller than — ^, in vivid contrast with the angle-average 
approximation.— For vanishing warping, this factor be- 
comes — |, in agreement with the theoretical work.— We 
note that the above formula is fulfilled for weak warping. 
On the other hand, one can estimate the a for Bi2Te3 
at low surface density N -C 10 13 cm -2 . For instance, 
a ps —0.506 when N = 10 12 cm~ 2 . However, the value of 
the a obtained from fit in recent experiment^ is —0.39, 
which is larger than —0.5, conflicting with our formula. 
This may be due to the inevitable bulk states contribu- 
tion in three-dimensional TIs. ?§ The experimental obser- 
vation of a is a collective result of the surface bands and 
bulk bands. The bulk channels may result in a weak lo- 
calization term, which could reduce or even compensate 



the weak anti-localization arising from the surface states. 
Therefore, a larger value of a is obtained experimentally. 
In contrast to the surface bands, the bulk subbands of 
TIs have a quadratic term and large band gaps. As a re- 
sult, a different density-dependent behavior of quantum 
correction is expected for the bulk channels. A quanti- 
tative measurement of the carrier-density-dependent sur- 
face conductivity correction could be helpful for distin- 
guishing the surface contribution from the bulk one. 

In the presence of magnetic scattering, the divergence 
of C(q) when q —> vanishes, which is analogous to 
the case without warping. 21 Therefore the logarithmic 
correction disappears, and it could be deduced that the 
magnetic scattering suppresses the weak anti-localization 
effect in the presence of both magnetic and nonmag- 
netic scattering. This is in accordance with experimental 
observation^ 

VI. CONCLUSION 



In summary, we have investigated the surface transport 
of a three-dimensional TI both in classical and quantum 
diffusive regimes. In this study, we include the role of 
the hexagonal warping correction of Fermi surface. It is 
found that the hexagonal warping has drastic effects on 
the surface conductivity and CISP of a three-dimensional 
TI for both nonmagnetic and magnetic elastic scattering. 
For surface state with large warping, such as Bi 2 Te 3 , an 
additional quadratic carrier density dependence is found 
in both two regimes. Because the carrier density could 
be controlled by the gate voltage, hence, we hope that 
our predictions will soon be verified experimentally. 
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